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I.. INTRODUCTION 

• •» 

A few months, ago a curriculum dey:elopment tefjn completed a three-year 
project, and delivered its 80 products to .a publisher. The project cost over 

a million dollars, and it emp;j.oyed an^ayerage of fourteen people. As project 

^ ^ . - ■ ' I • 

director I have been asked to review and critique and analyze the project as 



though it were a model system .for curriculum development with particular / 
theoretical, underpinnings. People s^em to want from me a paradigm ik^x doing ^ 
it again,- or for doing somethiQ^ si^iiilar. There seeras= to be considerable 
interest in contracting for curriculum development, management procedures-, 



staffing^, and quality coiltirol me^^ures. And the premium attached to' whatever 
. pre script ions" I might offer seeme^ related to the pjsrceived innovative^ness Snd 
.productivity of the project. A curriculum project which is innovative and 
productive should, be able to^'teach some lessons, they seem to say. And • 
indeed our pro.lect can be viewed as though it produced a sophisticated 
delivery system nith clever pre-packaged experiences and an array of media. 

Nevertheless, this pape:^ is. not a response to that kind of concern-. -Dome- 
place else, at some cither time, I will write about .how a systems approach mi^ht 
help others ^eyelop media for learning. And I will tenderly try to.,.talk of,^ 
those ..institutional concerns about controlling and replicating the process 
without widening the 'gap between curriculum rhetoric and performance. After 

all, there are matters to.be analyzed for improving how curriculum developers 

»■% 

do their work in institutional settings. Most of it goes on there, anyway. 
'Instead, this paper is^'more about the roots of curriculum work. I want 



to consider how our ciirriculujn development* staff went about identlfyinp: educational 
content and finding ways to^ 'maKe d:b^ available to younp: neople . . This root concern 
. 'was embodied in a parbicular pyiase of the project: the (ievelor)ment of prof^ram 

and product., criteria. This Pha^e of the pr.o.lect was the most critical for me 

• ■ ^ . 

as- the project director because it^ was the means by which we coul-d collectively 
*• / « 

envision how certain kinds of ed.Ucational experienc'es can be made accessible 
io. students through classroda'>*use m^.terials^ I will toll you about some, 
deliberatfions we engaged In*' to derive, a relatively ^simple set of overall 
program criteria which in^ilud^d Criteria for ^product development. While I donV. 

. ■ V . 

know if what we did should s^^e as a model for anyone else, I do remember the 

/ ■ . 

* ■ 

criteria development a^^tivlty off our r>rPject as .the solution to a major problem 

we faced. Criteria development ^Iso seemed to alleviate come lesser problems,. 

• • • ' . , / ^ * . • • " 

as well; / *" ' ^ . 

I want to address this topic jnostly througW ah introspective" lens,,. giying„' .„ . 

at times my very jSersonal ide^g about the problem and itr; solution. I want to 

taJLk about this jfeis I wish oth^r CLurriculum developers to talk' to me about what 

fthey did. Schwkb (1969) Bays tj^e curriculum field is moribund, and Huebner 

pL9t6) saya-*i1/s practically d^ad. I can assure you that -curriculum work never 

seems more so than when there is no one to talk abput curriculum development 

as penaQnal /experience . 



J , II. BAGlQ^KOUiyrD FOR cRrrmA^''^ 

We conducted the curriculum developjn^t project at The Center for Vocational 

Education at^ the Ohio State ■Unive:fgity. Entitled The Occupational Exploration 

/ ' / * ' ' ^ ■ . ■ 

Program, itis name failed to d^ncrte the project in either its first stage or 

/ / V ' . - . ■ ■■ 

its second/ stage. Now the set of products is entitled.. Seek in the publication 

and rharketing stag6. Include^ are'simulauions ^ games; eCnd assorted other 

/ ■ I \ ' ■ ■ ' ^ ■ • ' • ' 

. products Resigned to promote Occu-^afional exploration. ^ , • 

■ .■■I . ■ , ■ 



The first stage of OEP had ^.ts origins in Model I, the School-j3aseci Model 
of The Comprehensive Career Education Model (CCEM). Ar; part of a vast Instruc 
t;|.Onal sy.stem under development, the CCEM staff had determiried*"lihat si'mulat Ion 
was the best "delivery system*' to be aimed at ,iunior high classrooms and lihe 
p'eople in them. In August"^ 1972, when I cam© bo work on CCfiM, I found people 

on ^i^on'fe hand thinking about now adolescents might ^attain exploratory ob.iectives 

' •• ' . ■ 

which I thought seemed liberating and growth-producing; And pn the other 

hand plans were being made for massive development ^and installation of 

complex, high-fidelity simulated replicas ^f work world tasks. 't'Tiese :*^imii- 

litions would be systematically organized to involve the student in a full- ^ 

scaie management system of cov.ei^ng: the career cluster waterfront, Th^ richer 

the media-mix, the better, and^where reading mi^ht be required, another media 

~. :\ . ■ ■ ■ ■ ■■ ' ■ "- 

al1?ernative to" reading, would be provided. Furthermore, it was intended thai 
students would opt in and out of^ clusters and simulations according to their 



motivation and interest's. But also these siraulati6ns would be self-managed 
or teacher-free. 

In ray mind -these plans would require^ a radical reform of both the 
physical and psychological character of school settings, I^ was quite 
conc^ned about the basic '^inconsistencies and. conflicts I saw emerging , . .and 
I found ±4 hard 'bo live v(ith many of the assumptions guiding the^conceptual- 

' ■ - ry 

ization of btcupational exploration: I couldn*t .agree with th^ need for 
a system which denied the legitimacy of adolescence and the tjentativeness 
of that growth stage. I feared a system that would cause ap»^ adolescent to. 

'• ■ ■ '.J- 

become embarrassed by his or her indecision and confusion.r-y And I couldn't.' 



see how convergence on a systematically generated occupata'onal deCisioft^l^a 
much to do with real exDloration.. It was ludicrous .to t-ry to show adolescent 

;.■ . ■. ■ ■ ■.II • ^ 

exploration oh a flow chart. rr ' 



Whllfe I was concerned, these matters iVfere" not = directly i^y bifniness 

„ • /■ ... . 

since t imB working on diffferent, unrelated pro.ieots^ Before long The 
Occupational Exploration Program became a separate project distinct from 
the Comprehensive- Career ^Education Model. The staff forged ahead with the 
^produ^tion of a set of complex ^ siraulatiohSf destined to be the core of the 
• program. Toward the end of the first y^ar of prototype development amid 
some organisational reshuffling, I was/ assigned as task force leader -of the ■ 
project, ^-/hile I had already learned- the hard" lesson "of bureaucratic niceness 
X nevertheless felt coiirpelled to voice my concerns about the qualitleis of 

/ ■ ■ . .,/ ■ ' ' . . ■ 

/ the educational experience GEP seemed to^ embody. . It^ was some relief to find 

' . ■ / ; . ' ■ ^ 

that many OEP st^ff had come upon ^imllar concerns their own way, and I 

■ ■ ■ ' / ■ ' 'o ' ' .... 

found that some of the cavalier specifications for an OEP machine ha< been ■ 

■ • ■ ^ <i /" ' • 

tabled.^ Meapwhile, evaluations ^6f the prototype simulations seamed to show ' 
that the simulations, were producing some desired ■ results . Even though* they 



were tested under ^special conditions, students seemed to show gains in occu- 
pational information and changes in at 'itudes' aboi:^i the Occupations they ' • 
encountered. And despite the serfouB,- pervasive problems pf content, process, 
^implementation, and acceptability, a conclusion was drawn that the simnlaticn 
form could work. N5y ^.unresolved question wa^ whether pr^ not seeminp: gains 

0 

.o / " . « t ■ 

in occupationaSi infonfiation and changes in attitudes toward certain occupation 

meant that occupational e^lor.atipn wa^ occurring. ' 

. If this history I ajti providing seems impertinent, I should explain 
• *" ^ / ■ ' :*• ; ■ • • ■ . ■ " ' -u 

that these background probliems suddenly became mine. Amid further 

reorganization, I was .appointed as project director. As task -"force leader^ 

my sensibilii^ies were disturbed, but I had little access- t,o change^the c 

developmental direction of OEP. As project^ director, however , awakened 



to a^.more poigf>anl/ feeling of personal and professional liability 



Across-the-board consensus mahdated that the 013P. pro;ject should be 

\ ^ ' ti * * . *^ , 

continued for. another year of development, but that it must be wholj;/ 

•• . ' ■ ■ , ' ' 

reconceptualized and restructured* I saw that we could orpianize ourr.elver> 

a,p a design team with raaxiraum emphasis on collegial work, and at this 

turning point in the history of The Occupational Exploration 'Proprrajn I 

believe we began to develop for the first time a 'set^ of p3X>gram criteria. 

We were willi^ to talk at length about the quali.ty of. educational e:cperiences 

which might be embodied in the new OEP, and about design options available' 

to us. And as we worked on our official proposal for pro,iect continuation, ^ 

in effect we creatied a plan for researching and generating program criteria. 

While we taiUked, about redesigning OEP, we also anticipated that quality 

control needed ciareful consiLderation. Surely a pro.ject director "must be 
• , s# 

■ • " ■ . t— 

concerned with quality control mechanisms. I wanted one which would enable 

'developers to reach towcurd levels of quality they .understood and to know 

how close they were corai.ng. The important issue' of quality control and 

what we did about it is the topic of a related t)aT)er, Altschuld and Lr.ve'n 

"A Retrospective Analysis of the Development of a Project Monitoring System.-' 

But before quality 'control made any .difference ,1 had to be concerned with 

the. goodness of the classroom experience for which OEP was^ to be redesigned. 

^ ' III. DEVELOPMEI^ OF PROGRAM CRITERIA " ^ ^ 
The second stage of OEP began with a few givens . V7e developed our 
continuation proposal which specified a series of milestones and" tasks to 
'be accomplished, and a resource aij-Ocation and management _plan. V/e knev? 
the quantity of work to be ac conrpli shed, ' and' , how much time we had.-.- Only* 
a fW qualitative 'inspects were, given. For example, we would contiriue to 
emphasize use of the simulation technique,, and so whatever is inherent in 
simulations would also be found in-^the new OEP. The whole picture of the 



prbgraiQ and its products had to be researched, conceptualized , and p;iven 



. I 

.^hape in products yei: to be, specified* These wofuld be the pro,1ect^R 
deliverables* 

But the most Important new constraint was that for the first time 

/ ■ • 

The/Occupational Exrploration Program had to become conxnercially publinhable . 
The sponsor* required this, and we thouf^ht it was, a good idea. Ribl^shers 
do seem to have . excellent access to schools^ and the notioVi of our creating 
a set of materials and seeing it Tubltshed was very appealing. . This one 
.broad criterion would have a 'profound effect on our work, however. Now 
our deliberations to genJerate criteria were confined to envisioning only' 

the .sort of educational activities which might be printed, fabricated, and 

. k- ■ ' ■ 

■ ' • . 1- 

raarkeied by a publisher.- The economics of publishing bedame a screen for 
our future inventions, an^ iti underscored ^the importance of streamlining 
both the process and the products*, 

An energizing factor which seemed to impress me and other staff members 
was that were were contractueuLly responsible for effective design creativity 
rather than for running a curriculum product mill. The contract • itself , ' • 
even with all of. its cooly dispassionate language, seemed to heip set 
format for rigor and creativity. The initial core 'staff had succefsfully 
proposed to design ant3 develop a curriculum program yf=?t to be specified, " " 
and that represented a prior commitment to criteria development . . I' sensed 
a genuine acceptance of the problem situation, and to me this acceptance is 
a canonical first stern in'any design process. We had stated our initial 
intentions and accepted the problem as. a challenge. Collectively we gave 
up our autonozro^:" to the problem and we allowed, the problem to become our 
process ^- a design process. . ^ 



. The next set of deliberations for developing program criteria pertained 
to an analysis of the problem. We needed to get to know the ins and outs 
of ^the problem and discover what the world of the problem looked like. Tn 
do this we used formal and informal means. 

.We considered the pilot test data collected earlier during the first 
stage of OEP development. Through data analysis" and interpretation, we 
derived a list of refinements needed in the simulations as though the. pilot- 
teary Was. our only source of knowledge about what to do... But it was easy to 
extrapolate from those findings what our ultimate criteria, might be like. 

We also conducted a formal literature review as a way to analyze and 

get to know the problem. We read and deliberated about simulations at^d ^ 

■ ' ■' / 
games,. and the differences between them. We considered literature on mental^/ 

health -and the work ethic , and talked about how necessary it is to avoid / 

glib assumptions about how education, work, and the labor market go together. 



We established points-of-view which moved us away from behavioral objectives 
and helped us articulate a rational^/ for doing so. And we concluded from 
any number of vantage points that we were not going to develop a program 
of materials whicTi would account for all of the students* occupational 
exploration. ^ 

It seems that as we looked at the litei'ature and talked about issues, 
I myself began to articulate 'a platform, for occupational exploration. And 
other members of the staff contributed planks, as well. The platfoi*ra took 
shape as we analyzed the problem, especially as we considered, all of the value 

laden aspects of occupational exploration which had been' neglected before,- I 

■ / 

felt that th^re was a great deal of deference to my opinions and to plat form- 
type statements I would make, but somehow that seemed/acceptable po me and 
to the others. Casting my confusions about manipulation vs.- control ^side, ■ 



. 8 ^ 



I provided. conceptual leadership and direction which, I fear, sometimes , 
bordered on bravado, MVith ny promptings and throup;h o\ir .deliberations , we 
informally adopted platform planks about such matters as the t,entativeness of 
adolescence. For example, we asserbed-that adolescent beha:vior is natural 
and good, and that OEP thould use it instead of . trying to get « rid of it. We 
made statements about broadening' exploratory possibilities instead of narrowing 
them, anS whether students should en/^age in simulations^ to see the" working 
world as it is or as. it might be . And I' talked a great deal about what 
might occur in classrooms through OEP, and I explained my bias toward ^-^-..^ 
attaching a legitimacy, to students' metaphoric and • intuitive abilii;.ies as 
well as their rational emd linear capabilities. 

The =next deliberative stev we took was to conduct a market review. We 
needed to find out who would want OEP and under what circumstances. At that • 
point we had many bits of criteria information in. our hopper — information 
about prototype .simulations, literature reviews, and lots of our own ideals 
and interpretations. ITie market review put .us in the position of having to 
take a tentative stared on the basis of our amorphous pile of criteria and . . 
the emerging platform for OEP. We organized and conducted a conference 
which included the OEP staff, the si>onsor, as well as teachers, principals, 
guidance counselors and publishers. Frankly, while we did derive some 
new information, the market review and conference seemed to corroborate 
and focus the data we already had. To conduct the conference, we had to 
sort what we knew and what we needed to know, and we also had to portray 
the clearest picture of our intentions as we understood them. 

A .final deliberative phase involved goin^ to the wall. The staff 
covered an entire workroom wall with butcher paper and began cutting and- 
posting and dategorizing hundreds of slips of criteria information . More 
shifting and sifting was'followed by sorting and reporting. Duplications 

ro 



were cast out, and soon common perspectives could be merged, and the vol\im6 
of individual information pieces was reduced. Then, when the wall had' 
served its purpose, the newly ordered and classified criteria in raw form 
were tediously transcribed into booklet form and color coded «o we would 
always be able *o retrace the sources for any criterion. The 'last, honlnp: 
of the criteria took place, and a brief descripMon o^f the progr-am was written 
to introduce the outline of criteria for program and toroduct development which 
.had finally been generat'fe^, . , 

We tended to treat the critieria we stated as thoup.h they were promi.sen 
we would, keep, and so we were cautious not to promise more than we would be 
able to deliver. As a safeguard, qualities of the program, which were*^ vital 
to. us, but not. safely promised as criteria were dealt wi*th in the narrative 
.program description. The final criteria were grouped: (a) CharacteriSuicn 
of Program Activities, (b) Characteristics of Occupational Information, 
(c) Characteristics of Instruct j^al Materials , and (d) Characteristics of 
Program Marketability. • ' ' 

IV. TItE PROGRAM CRITERIA' ' " 

Characteristics of I^ograji Activities 

1. Activities 11 include a balance ounoriQ solo, sm»all f^oup; and 

large group explorations. Tliey -vail include occupational -siirnila-^ 
tions, learning games, and other techniques . "VTiiich encourap;e active, 
exploration. . ' . ' ^ 

■' 2, The simulations \rill constitute major exploratory activities. K.-'xch 
.simulation 'should require from 7 to 15 class sessions (or instruc- 
tional houris)^ involving from 7 to 12 siudentsv ^ ' 

3/ Other exploratory activities in aiiditij^n to' tK'e simulation should 
-^afford the .flexibility^" to involve other students for I5 class 
sessions (instructional hours) or more. 

U. Activities will be ..included that allow students to make work-related 
judgments and decisions. 



5. ActlvltleD will be included that allow studetita to practice expJ ora- 
tion skills. • 

■ 6* The program \ri. 11 be varied in its appeal ii\ order to Gncouroye 
, seif -initiated explorations.^ 

... '='7. The program "vri-ll be manageable by students to enable them to cur.^^i^o 
{ , in s elf -cif firming ^activities. 

8. V/herever possible the program should allow students to use personal 
knowledge and skill to effect exploratory outcomes. 

' ' 9. The progreun activities will take into account: „ 

* . ' ' a. ^how the students* emerging values "^di 11 influenc'e their 
ability to make choices in the world of work. 

b.. the; importance of students' discovery 'of personal needs 
and the recognition^ of ways^'in which these needs can be 
satisfied in the"* world of work, 

* ^ . c.- the need for students to exercise volition in developing 

their skills and capabilities. • . 

Characteristics of Oecup a tipnal I nf drmation 

1, Information about !occupat*ions and occupational work factors vn.Il.be 
included that is immediately useful to the student to help him or 
her engage in the exploratory activities. 

2, V/hile T occupations and occupational work factors will ^not be repre- 
. sented, the program will contain a representative range of occupa- 
tional work factors, including: 

' - . i / ■ 

a. Work responsibilities ; those personal, interpersonal, 

ethical, legal, contractual and functional behaviors and :^ 
V tasks which account for relative' success or failure in ^ 



occv^pational endeavors. ■ 



b. Wo rk relationships ; those interconnected dealings of 

people who are reciprocally interested in various outcomes 
of occupational endeavors. * 

c- Work processes : those actions, operatiorfs, or mefhod^s 

performed individually or, in groups which yield particular 
• rtsuits in occupational endeavors. • • " 

■ .... . .•■(■•• ' ■ - 

d. Work enfaronments .; those physical, gehfrapnic, -social iu\d 
psyfehological' factors that* surround and impinge upon aji 
occupa^iional endeavor /and influence the individual or the . 
group involved in that endeavor. ^ ^ . 



e. Workioutcoanes : the personal aM . social effects, .consequences 
. results,", events, products £Uid issues v^Jiich result frjDn the 
Goniplex of work resi)onsibilities, 'relationships ,' processes, 
and environments of, occu^)ational endeavors. * 

•3-. • The program will represent "occupations and workers without unfair bias 
or distortion. " 

■ - , ^ 
' The prograjn will treat occupational characteristics in light of the- 
chah^ng -nature of personal, economic, and societal characteristics. 

5 r. Occupational characteristics will be^ represented by information that: 

a, reflects jconteraporaary conditions and^ projects- trends, 

b. is jaccurate- at an ^appropriate levelVof detail, 

— ^c. may be\siiiTplified "^so that J^he informastion will be appropriate 
^ ' - and useful in the ^. ongoing exploratory' process. 

^ ; d,> encourages students. to look forward to participation i:i the 

mainstream of economic life. 

'6*- The program will help students identify the value of individual occupd 
tional 'endeavors rather , emphasize* the ''comparative status associated' 
with occupations, ^- , 



• Characteristic s of Instruq tiotx&l Ivlaterials 



' 1. The instructional materials will be ^sable mth' facilities and audio- 
" : visual, equipment generally available to middle schools and junior 
\ ^ high schools. v i . > 

2. The packaging of program .materials will facilitate- the? r -distribu - 

* tion, retrieval, maintenance, and storage in conventional classrooms.' 

3. The program materials will be designed vrith full consideration of 
; their attractiveness and appeal for both students and teachers. 

Chara cteristics of Prog ram Nlarkel^Mjj^^^ ^ ^ 

■ — ~" ■ '~~[ 

1. The prograjn id.ll be designed for use by students who 

a. are approximately 12 to lU years of 'age. 

' • Id;,' Var'e'at the'^ or eigjith grade level or equivalent, 

but not n^cessariily precluding students at the sixth or 
J ninth grade level or equivalent • 
> * ■ ' . 

^. ■ * c, have the ability to engage in some independent work. 

d'. have ,the ability to participate effectively in small group = 
* ^ ' act?.vities« 



1 



s 



■ ' ^ ■ - 12 - . 

2. The prograjn will be. cost competetive with other multi-media inctruc: 
tionai progranis being marketed. 

3; The program design and materials will facilitate diversified use by 
schools through: - ^ ' 

a* making the program components useful whether all of the 
program or selected parts ore purchased. 

b, allowing for teacher and/VDr student selection, pacing, » 
knd grouping of coii5)onents'^'ror classroom use. 

■c. allowing for administrative flexibility in implementing 
the program, including: . - 

1. staffing variations 

2. scheduling adjustments 

3. a:ccess of facilities 
k. provision of equipment 
5. application in various subject areas . 

d. Program activities generally will, afford flexible use in^; 
cvorious subject areas, and will- help teachers enhance the,, 
•relevance of subject matter to the student* s experiences. 



V. SUMMARY AND CONCLUSION = * " , 

■ f '- ■ ■ 

The development of program and product criteria for The Occupational *' 

V ... , . . • 

Exploration Program was an indispensable sequence of project activities which^ 
enabled us to\ clarify purposep and find reasonable direction for our work. • / 
It was' a way for us to discover the ins, and outs of the curriculum problem 
at hand, and to discover what the world ox the problem looked like. As 
we defined the limits of the problem, we were freed from much uncertainty 
and\unbiguity. -.rln particular, criteria development helped us envision the 
e^ducationeO! settihg for which the contracted deliverables were intended. 
The process forced us to. the useful "iask of envisioning what desirable ^ ^ 
experiences we wanted to stimulate for teachers and students in classrooms-* 

The criteria development also helped ua approach tlie problem as an 
ensemble interested collectively in the crafts of. curriculum development ... 
Developers who, in an- earlier stage of the project, had very limited 

' ' ' ' ■ ■ 1.4 ■ ■ ■ / ■■ ^ . • 



responsibilities and tasks to perform soon ' Btc^e ' more integrally involved . 
as we sought criteria. The character of ' staff interaction also seemed to ^ ; 
change, and all of the varied expertise attained a status of legitimate 
ImportRnce, Wheras trained graphic designers formerly had been considered 
mere technical illustrators, they became conceptualizers during the criteria 
development phase. Their stance changed as they saw they could apuly their 
trained ejcpertise to this design problem. . " 

The seAse of proprietorship the staff had regarding the problem and 
the. related need for criteria made ny work as project director different, 
and perhaps more Effective. Just as I provided leadership in interpreting 
the emerging criteria and platfonn planks, I was also' able to work with ^" 
developers later as we began to work'' on ^style , tejcture, and technique in . 
the actual materials. Vty- early work' with developers to model our first 
products W not have worked so well without the criteria development phase,, 
bihind us'. I believe that the criteria gave .us , great latitude for creativity 
and invention, not only for the- initial core staff who generated them, but ^ 

also for the new staff members who. arrived later. ' ^ 

And finally, 'the cxit^eria-development-^ase helped establish a workin/? 
monitoring system in which developers were- able to critique- and refine ■ . 
■lihei^ colleague '.s work. With the^review syrtem in effect and the criteria 
in hand, devqlop^rs were continually able to. deal with new ways to realize 
the criteria and to enlarge their understanding of what occupational exploration 

♦ ^ " ,' - • . 

o ^ k ■ 

for adolescents cen mean-. . ^ ' ' ^ , 
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